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Generators 



(N 
O 

o 

(N 

a,. 

CD 



Shu-Ju Tuj^] and Ephraim Fischbach]] 

Department of Physics, Purdue University, West Lafayette, Indiana 47907-1396 

(Dated: February 2, 2008) 

We present a new computational scheme, GRIP (Geometric Random Inner Products), for test- 
ing the quality of random number generators. The GRIP formalism utilizes geometric probability 
techniques to calculate the average scalar products of random vectors generated in geometric ob- 
jects, such as circles and spheres. We show that these average scalar products define a family of 
geometric constants which can be used to evaluate the quality of random number generators. We 
explicitly apply the GRIP tests to several random number generators frequently used in Monte 
Carlo simulations, and demonstrate a new statistical property for good random number generators. 

PACS numbers: 02.50.Ng 
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I. INTRODUCTION 

Monte Carlo methods are among the most widely used 
numerical algorithms in computational science and engi- 
neering [Q . The key element in a Monte Carlo calculation 
is the generation of random numbers. Although a truly 
random number sequence produced by either a physical 
process such as nuclear decay, an electronic device etc., 
or by a computer algorithm, may not actually exist, a 
new and computationally easy-to-implement scheme to 
investigate random number generators is always highly 
desirable. 

There have been many proposed schemes for the qual- 
ity measure of random number generators |^, 
1' 0' 1' Hi- These computational tests are based either 
on probability theory and statistical methods (for ex- 
ample: the test, the Smirnov-Kolmogorov test, the 
correlation test, the spectral test, and the DieHard bat- 
tery of randomness tests), or on mathematical modeling 
and simulation for physical systems (for example: ran- 
dom walks and Ising model simulations) . These methods 
also open the door to studying the properties of ran- 
dom number sequences such as randomness and com- 
plexity . Some important attempts at an operational 
definition of randomness were previously developed by 
Kolmogorov and Chaitin (algorithmic informational the- 
ory) [l2| , [l^ , [l^ and by Pincus (approximate en- 



tropy) |Ij 

In this paper, we study a new method to measure n- 
dimensional randomness which we denote by GRIP (Ge- 
ometric Random Inner Products). The GRIP family of 
tests is based on the observation that the average scalar 
products of random vectors produced in geometric ob- 
jects (e.g., circles and spheres), define geometric con- 
stants which can be used to evaluate the quality of ran- 
dom number generators. After presenting the simplest 
example of a GRIP test, we exhibit a computational 



method for implementing GRIP, which is then used to 
analyze a number of random number generators. We 
then discuss the GRIP formalism in detail and show how 
a random number sequence, when converted to random 
points in a space defined by a geometric object, can pro- 
duce a series of known geometric constants. Later we 
introduce additional members and include them within 
the GRIP family. We then present the computational 
results for configurations of four, six, and eight random 
points, along with a consideration of some key issues. 
Finally, we conclude by discussing how the GRIP test 
measures the quality of random number generators by 
explicitly adding a new quantitative property to random 
number sequences along with the three known qualitative 
properties summarized in Ref. [Eol. 



II. GENERAL DESCRIPTION OF THE GRIP 
FORMALISM 

The GRIP scheme is derived from the theory of ran- 
dom distance distribution for spherical objects, and can 
be generalized to other geometric objects with arbitrary 
densities [ |l6| , pT| . First, three random points (ri, and 
ra) are independently produced from the sample space 
defined by a geometric object. We then evaluate the aver- 
age inner product of ri2 • r23 from two associated random 
vectors, fi2 = r 2 ~ and ^23 = ^3 — ^2- For a geometric 
object such as an n-ball of uniform density with a radius 
R, the analytical result is a geometric constant which 
can be expressed in terms of the dimensionality n of the 
space [16, 1%: 



{ri2 ■ r23) 



(1) 
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A simple derivation of Eq. (^ can be found in the Ap- 
pendix. 

The following procedures are the numerical implemen- 
tation of our testing programs. A random number se- 
quence produced from a random number generator is 
used to generate a series of three random points ri, r2, 
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and r*3 such that these random points are uniformly dis- 
tributed in an n-dimensional spherical ball B of radius 
_R, where 

B = {{xi,X2,--- ,Xn):xl+xl + ---+xl< R^} . (2) 

We then compute a series of values for fi2 ■ ^23. If fi2 ■ r23 
is evaluated N times, then statistically we expect 

1 ^ 

i—i 

as predicted by Eq. (pi). 



III. RANDOM NUMBER GENERATORS 

We now apply the GRIP test to the following random 
number generators frequently used in Monte Carlo sim- 
ulations. 

1. RANG - a linear congruential generator ^: 

Xn = 16807 X x„-i mod 2147483647. (4) 

2. RAN3 - a lagged Fibonacci generator H, ^: 

x„ = {xn-55 - Xn-24) mod 2^^ (5) 



9. NWS - a nested Weyl sequence generator [21, 23]: 



Xn^{n{na}}. (8) 

10. SNWS - a shuffled nested Weyl sequence genera- 
tor [|l], ||: 



Sn = M{n{na}} + 
where M is a large positive integer. 



(9) 
(10) 



The computational results obtained from Eq. (|^) when 
n = 3 and n ~ 9 are presented in Table |. Results 
for random number generators based on other algorithms 
such as the Data Encryption Standard (DES) ^ can 
be found in Ref. |^ along with the computed results 
obtained from other geometric objects. We note that 
both the ran_gen and RANO generators perform better 
overall, while the NWS and Weyl generators (which are 
based on the Weyl sequence method) are ranked lowest 
compared to the other generators. The reasons why this 
is the case will be discussed later. 



IV. GRIP ANALYSIS 



3. R31 - a generalized feedback shift register (GFSR) 
generator ||, |, |l: 

X„ = Xn-31 ffi Xn-3, (6) 

where © is the bitwise exclusive OR operator. 

4. durxor - a generator selected from IBM ESSL (En- 
gineering and Scientific Subroutine Library) |18| . 

5. durand - a generator selected from IBM ESSL (En- 
gineering and Scientific Subroutine Library) and 
the sequence period of durand is shorter than 
durxor 

6. ran_gen - one of the subroutines in IMSL libraries 
from Visual Numeric ||l^ . 

7. Random - a Fortran 90/95 standard intrinsic ran- 
dom number generator pO| . 

8. Weyl - a Weyl sequence generator [|l], 

Xn = {na} , (7) 

where {x} is the fractional part of x, and a is an 
irrational number such as \/2- 



In the following, we analyze the relationship between 
GRIP and a random number sequence, and show how a 
good random number sequence, when converted to ran- 
dom points in a a space defined by a geometric object, 
can produce a series of known n-dimensional geometric 
constants. A random number sequence generated from a 
random number generator can be written as, 

010203040506070809010 (11) 

When the sequence is converted to represent random 
points in a 2-dimensional geometric object, the random 
numbers in Eq. ( pT| ) can then be grouped in pairs as 

(0102) (0304) (osOe) OTOsOgOio , (12) 

where Cartesian coordinates are used. The first set of 
random points {ri, r2, ^3} can thus be identified as 

ri = (01,02), r2 = (a3,a4), r3 = (05,00). (13) 

GRIP then uses fi, r2, and ^3 to evaluate the average 
scalar product which can be computed by rewriting. 
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TABLE L Computed results for {fi2 ■ ^23)^. RNG denotes the specific random number generator defined in the text, and 
"Expected" is the exact result obtained from Eq. (^). The entries are ranked in terms of their errors, which are the absolute 
values of the differences between the expected and computed results. For each entry in the table A'' = 10*, and multiple seeds 
were used where appropriate. 



Rank 


RNG 


n — 3 


Error 


RNG 


n = 9 


Error 


1 


ran_gen 


-0.59999802 


0.00000198 


RANO 


-0.81819136 


0.00000955 


2 


RANO 


—0 fifl0fl0799 


n 00000792 


van o'PTi 


—0 81 891 041 


00009860 


3 


R31 


-0.60005031 


0.00005031 


Random 


-0.81821550 


0.00003369 


4 


durand 


-0.59991945 


0.00008055 


durand 


-0.81821772 


0.00003591 


5 


durxor 


-0.59991306 


0.00008694 


durxor 


-0.81822185 


0.00004004 


6 


RAN3 


-0.59988610 


0.00011390 


R31 


-0.81824459 


0.00006278 


7 


Random 


-0.59987912 


0.00012088 


RAN3 


-0.81827541 


0.00009360 


8 


SNWS 


-0.59969277 


0.00030723 


SNWS 


-0.81795246 


0.00022935 


9 


NWS 


-0.62988317 


0.02988317 


NWS 


-0.82539808 


0.00721627 


10 


Wcyl 


-1.80809907 


1.20809907 


Wcyl 


-1.05604651 


0.23786470 




Expected 


-0.60000000 




Expected 


-0.81818181 





{ri2 ■ f23) 



N 2 



a,6i-4+j — o-ei-e+j) (0.62-2+^ — 0,61-4+ j) , 



=1 ]=i 



r 



(14) 



where iV is a large positive integer. When the geometric 
object is a circle of radius R and uniform density, we 
expect {fi2 ■ f23) « — 0.5i?^ as predicted by Eq. (||). 

The analysis for 2-dimensional GRIP can be imme- 
diately generalized to the n-dimensional case. When the 



J 



sequence in Eq. ( pT| ) is used to generate random points in 
a n-dimensional spherical object, we can regroup Eq. ( pT| ) 
as follows: 



(«! ■ • • flfc) (flfc+i ■ • • a2k) (a2fe+i • ■ • flsfc) (•■■)(•■•)(■••)■ 

I 



(15) 



The average scalar product of fi2 ■ r23 can then be ex- 
pressed as 



J 



^ N n 

{t'i2 ■ ^^23) = ^ 5Z io-3in-2n+j — a3Mi-3n+j) {d^in-n+j — a3m-2n+j) ■ 



(16) 



.1 j=i 



When the geometric object is an n-ball with a radius 
R — 1 and a uniform density, we expect from Eq. (|^) 
that the result of Eq. ( p^ should be a geometric constant, 
-n/{n + 2). 



GRIP MEMBERS 



For practical computational purposes, we may wish to 
transform a random number sequence from a uniform 
density distribution to one which is non-uniform. One of 
the most important non-uniform density distributions is 
the Gaussian (normal) distribution P{r) with mean zero 
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and standard deviation <j. 



P{t) 



(27r)"/2cr" 



-(l/2)(rV-^) 



1/2 



(17) 



and n 



Here P{r)dr = 1, r — (xf - 
is the space dimensionality. One can use either the 
Box-MuUer transformation method to generate a random 
number sequence with a Gaussian density distribution, or 
use available subroutines from major computational sci- 
entific hbraries such as IBM ESSL and IMSL @ By 
applying the probability density function of the random 
distance distribution as discussed in Ref. one can 
add a new GRIP member to investigate the quality of a 
Gaussian random number generator, and this new GRIP 
test can be expressed as: 



{ri2 ■ r23) 



(18) 



A very common situation arises when one has to produce 
random points uniformly distributed on the surface of 
an n-sphere of radius R. Some general computational 
techniques for doing this are summarized in Refs. p^ . 
We can then use 



{ri2 ■ r23)„ = -R^, 



(19) 



to examine the quality of such transformed random num- 
ber generators as discussed in Ref. [ p3| . 

Another application of the GRIP formalism is in 
stochastic geometry. We can design a test scheme for a 
configuration utilizing any number of random points [p3| , 
and these tests can be included in the GRIP family. 
Among the tests are: 



1. Four uniform random points configuration for an 
n-ball of radius R 



{{ri2 ■ r23) {r34 ■ ^4i))„ = 



{{ru ■ rsi) (^23 • r4i))j 
{ri3 ■ r24)r 



in + 2y 
2n 



in + 2y 



= 0. 



(20) 

(21) 
(22) 



2. 2m uniform random points configuration for an n- 
ball of radius R 



{{ri2 ■ ^23) ■ 



{r2m-l 2m ' r2m l))„ = (-1)' 



(n'"-i -t- 1) , 



(23) 



2, 3, 4 etc.) is a positive even 



where 2m (m 
number. 



A derivation of Eq. (|20|) can be found in the Appendix. 
We summarize the computational results for Eq. ( |2^ ) 
when m = 2, 3, 4 in in Tables 0, H, a nd 0. A dis- 
cussion of other results, such as Eqs. (18|) and (|l9|), can 
be found in Ref. [||. 

We observe that all of the generators except NWS and 
Weyl perform significantly better in n = 3 than in n = 9 
using the GRIP test based on ((ri2 • ^23) (r34 • ?^4i))„- We 
also note from Table |ll[ and the n = 9 results (from R31 
to RANO), that these results are clearly biased to larger 
numbers compared to the expected value. One interpre- 
tation may be that ((712 • ?^23) (^^4 • '^4i))9 is a more sen- 
sitive and dedicated computational test for investigating 
random number generators than other GRIP tests. We 
also note that the results for n = 9 are overall worse than 
n = 3, and that the results for ((ri2 • ^23) (r34 • r4i))9 
reveal a more significant bias than in any of the other 
cases. These results suggest that the GRIP test either in 
higher dimensions (large n), or using a configuration of 
four random points, can serve as a more computationally 
sensitive test to detect non-random patterns hidden in 



random number sequences. Finally we note that it is not 
surprising that the NWS and Weyl generators are ranked 
worst among all cases in our GRIP test. As reported pre- 
viously in , these two show unacceptable non-random 
behavior and strong correlations. 



VI. CONCLUSIONS 

We have presented a new computational paradigm for 
evaluating the quality of random number generators. We 
demonstrate how GRIP helps to understand complex- 
ity and randomness by adding a new property, besides 
three known properties (typical, chaotic, and the stabil- 
ity of frequencies) jTof , for random number sequences. 
This quantitative feature shows how a random number 
sequence, when converted to random points in a space 
defined by a geometric object, can produce a series of 
known geometric constants. Ten random number gener- 
ators were selected to run our GRIP tests, and they are 
ranked based on the errors between the numerical and 
analytical results. Finally we note that one implication 
of our work is that computational scientists should test 
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TABLE II: Computed results for {{fi2 ■ r23) (7^34 ■ rn))^. RNG denotes the specific random number generator defined in the 
text, and "Expected" is the exact result obtained from Eq. (^). The entries are ranked in terms of their errors, which are 
the absolute values of the differences between the expected and computed results. For each entry in the table A'' — 10*, and 
multiple seeds were used where appropriate. 



Rank 


RNG 


n — 3 


Error 


RNG 


n = 9 


Error 


1 


RAN3 


0.47999737 


0.00000263 


R31 


0.74538039 


0.00157874 


2 


RANO 


0.47995440 


0.00004560 


RAN3 


0.74567962 


0.00187797 


3 


durxor 


0.48004715 


0.00004715 


SNWS 


0.74582752 


0.00202587 


4 


durand 


0.48006530 


0.00006530 


ran_gen 


0.74634598 


0.00254433 


5 


R31 


0.48008265 


0.00008265 


durxor 


0.74637990 


0.00257825 


6 


Random 


0.47990347 


0.00009653 


Random 


0.74644366 


0.00264201 


7 


ran_gen 


0.47986482 


0.00013518 


durand 


0.74646979 


0.00266814 


8 


SNWS 


0.47975570 


0.00024430 


RANO 


0.74659547 


0.00279382 


9 


NWS 


0.55841828 


0.07842818 


NWS 


0.69652947 


0.04727218 


10 


Wcyl 


3.31162983 


2.83162983 


Wcyl 


1.28608478 


0.54228305 




Expected 


0.48000000 




Expected 


0.74380165 





TABLE III: Computed results for {(fi2 • r23) (r34 • ^45) (rse ■ rei))^. RNG denotes the specific random number generator defined 
in the text, and "Expected" is the exact result obtained from Eq. (^. The entries are ranked in terms of their errors, which 
are the absolute values of the differences between the expected and computed results. For each entry in the table A'" = 10*, 
and multiple seeds were used where appropriate. 



Rank 


RNG 


n — 3 


Error 


RNG 


n = 9 


Error 


1 


durand 


-0.24000387 


0.00000387 


SNWS 


-0.55453884 


0.00006852 


2 


Random 


-0.24001846 


0.00001846 


R31 


-0.55373136 


0.00073896 


3 


RAN3 


-0.23997958 


0.00002042 


ran_gen 


-0.55521687 


0.00074655 


4 


ran_gen 


-0.24003206 


0.00003206 


durxor 


-0.55524213 


0.00077181 


5 


RANO 


-0.23994286 


0.00005714 


durand 


-0.55528032 


0.00081000 


6 


durxor 


-0.24011639 


0.00011639 


Random 


-0.55533746 


0.00086714 


7 


SNWS 


-0.23964945 


0.00035055 


RANO 


-0.55561838 


0.00114806 


8 


R31 


-0.24070892 


0.00070892 


RAN3 


-0.55595656 


0.00148624 


9 


NWS 


-0.28813072 


0.04813072 


NWS 


-0.48246750 


0.07200282 


10 


Weyl 


-5.78662461 


5.54662461 


Wcyl 


-1.31133451 


0.75686419 




Expected 


-0.24000000 




Expected 


-0.55447032 





the random number generators they use in their simu- 
lations, and verify that their random number generators 
pass as many proposed tests as possible. 



as 1, 2, and 3 in Fig. and then calculate 

ri2 ■ = riarascose* = -ri2r23 cos a, (A.l) 



APPENDIX: DERIVATION OF ((ria fas))^ AND 

((ri2 • f23) (m • ^=4l)>„ 



We derive the analytical result of Eq. for a circle 
(n — 2) of radius R and uniform density. The same 
derivation can be applied to the case of n dimensions 
where n > 3. We label three independent random points 



where a+9 = tt. From the triangle formed by the random 
points, we then have 



' 31 ^ ' 12 I ' 23 



- 2ri2r23 cos a. 



(A.2) 



Extending this 2— dimensional case to the n-dimensional 
case, and combining Eqs (A.l) and (A.2), we then eval- 
uate 



1 11 r''^ n 

(ri2 • r23)„ = -- (r?2 + rl, - rl,)^ = -- (r^)^ = -- P^{r)r^ dr = -^R', (A.3) 

I 



where we have utilized the fact that ri2, 7^237 ^^id rsi are three independent random vectors. The functions Pnif) 
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TABLE IV: Computed results for ((ri2 ■ ^^23) (7^34 • r^s) (rse • re?) (rVg • rsi))^. RNG denotes the specific random number gen- 
erator defined in the text, and "Expected" is the exact result obtained from Eq. (|l]). The entries are ranked in terms of their 
errors, which are the absolute values of the differences between the expected and computed results. For each entry in the table 
= 10*, and multiple seeds were used where appropriate. 



Rank 


RNG 


n — 3 


Error 


RNG 


n = 9 


Error 


1 


ran_gen 


0.13440377 


0.00000377 


durxor 


0.44877762 


0.00003778 


2 




1 34-3Q07S 




J. Clrll_tidl 




flflOl 3053 


3 


RAN3 


0.13441796 


0.00001796 


durand 


0.44889786 


0.00015802 


4 


RANO 


0.13442104 


0.00002104 


Random 


0.44896356 


0.00022372 


5 


durand 


0.13437131 


0.00002869 


RAN3 


0.44910757 


0.00036773 


6 


Random 


0.13430897 


0.00009103 


RANO 


0.44924443 


0.00050459 


7 


SNWS 


0.13415229 


0.00024771 


SNWS 


0.44789799 


0.00084185 


8 


R31 


0.13684585 


0.00244585 


R31 


0.44684269 


0.00189715 


9 


NWS 


0.16328766 


0.02888766 


NWS 


0.46587567 


0.01713583 


10 


Wcyl 


10.1762479 


10.0418479 


Wcyl 


1.53996230 


1.09122246 




Expected 


0.13440000 




Expected 


0.44873984 







FIG. 1: Three random points configuration in a circle. 



which can be found in Refs. |l|, 0, 

are the probability density functions 
for the random distance r between two random points in 
an n-dimensional spherical ball of radius R and uniform 
density. 



We consider next the analytical result in Eq. (^0|) for a 
circle (n = 2) of radius R and uniform density. A similar 
derivation can lead to Eqs. (pi]), (p2|), and (|23|), as well 
as to the case of n dimensions where n > 3. We begin by 
expressing 4 random points fi, f2, r^, and ^4 in Carte- 
sian coordinates, where = {xi,yi). The expression in 
Eq. (GO) can then be evaluated by writing 



((^^12 ■ ^23) (7^34 ■ m))2 



dyi 



J-R dxij_ 



dyi 



rR , ry/R- 

■ J-R. dx4 j_ 



(A.4) 



dy4 



where 
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